A model of hippocampally dependent navigation, using the temporal difference learning rule.
نویسندگان
چکیده
This paper presents a model of how hippocampal place cells might be used for spatial navigation in two watermaze tasks: the standard reference memory task and a delayed matching-to-place task. In the reference memory task, the escape platform occupies a single location and rats gradually learn relatively direct paths to the goal over the course of days, in each of which they perform a fixed number of trials. In the delayed matching-to-place task, the escape platform occupies a novel location on each day, and rats gradually acquire one-trial learning, i.e., direct paths on the second trial of each day. The model uses a local, incremental, and statistically efficient connectionist algorithm called temporal difference learning in two distinct components. The first is a reinforcement-based "actor-critic" network that is a general model of classical and instrumental conditioning. In this case, it is applied to navigation, using place cells to provide information about state. By itself, the actor-critic can learn the reference memory task, but this learning is inflexible to changes to the platform location. We argue that one-trial learning in the delayed matching-to-place task demands a goal-independent representation of space. This is provided by the second component of the model: a network that uses temporal difference learning and self-motion information to acquire consistent spatial coordinates in the environment. Each component of the model is necessary at a different stage of the task; the actor-critic provides a way of transferring control to the component that performs best. The model successfully captures gradual acquisition in both tasks, and, in particular, the ultimate development of one-trial learning in the delayed matching-to-place task. Place cells report a form of stable, allocentric information that is well-suited to the various kinds of learning in the model.
منابع مشابه
Investigating the Effect of Music on Spatial Learning in a Virtual Reality Task
Background: Spatial learning and navigation is a fundamental cognitive ability consisting of multiple cognitive components. Despite intensive efforts conducted with the assistance of virtual reality technology and functional Magnetic Resonance Imaging (fMRI) modality, the music effect on this cognition and the involved neuronal mechanisms remain elusive. Objectives: We aimed to investigate the...
متن کاملEffects of medial and dorsal cortex lesions on spatial memory in lizards.
In mammals and birds, the hippocampus is a major learning and memory center that plays a prominent role in spatial memory, the use of distal cues to guide navigation. The role of reptilian hippocampal homologues, the medial and dorsal cortex, in spatial memory has not been thoroughly investigated. The medial and dorsal cortex of reptiles is known to play a role in learning both tasks that are h...
متن کاملEvaluation of remote sensing indicators in drought monitoring using machine learning algorithms (Case study: Marivan city)
Remote sensing indices are used to analyze the Spatio-temporal distribution of drought conditions and to identify the severity of drought. This study, using various drought indices generated from Madis and TRMM satellite data extracted from Google Earth Engine (GEE) platform. Drought conditions in Marivan city from February to November for the years 2001 to 2017 were analyzed based on spatial a...
متن کاملRecollection-dependent memory for event duration in large-scale spatial navigation.
Time and space represent two key aspects of episodic memories, forming the spatiotemporal context of events in a sequence. Little is known, however, about how temporal information, such as the duration and the order of particular events, are encoded into memory, and if it matters whether the memory representation is based on recollection or familiarity. To investigate this issue, we used a real...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Hippocampus
دوره 10 1 شماره
صفحات -
تاریخ انتشار 2000